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Description 

METHOD FOR RESTORING FADED 
PHOTOGRAPHS AND FILM 

Background of Invention 
[000 1 ] 1. Field of the Invention 

[0002] The present invention relates to a color restoration 

method, and more specifically, to a method for restoring 
faded pictures or film. 

[0003] 2. Description of the Prior Art 

[0004] Almost everyone has old photographs of their parents, 
their grandparents, or of their childhood. When it comes 
to aging, photos fade in many different ways. In general, 
the aged photos often take a yellowish color, and the 
negatives also tend to have a reddish tone with time. As 
there are various considerable causes of fading, precious 
color photographic originals should be kept under safe 
conditions whenever possible. Keeping photographs and 
film in dark places with a low temperature and low mois- 



ture can help slow the effects of aging, but cannot entirely 

prevent them. 
Summary of Invention 

[0005] it is therefore a primary objective of the claimed invention 
to provide a method for restoring aged photographs and 
film in order to solve the above-mentioned problems. 

[0006] According to the claimed invention, a method for restor- 
ing color of an image includes reading an original image 
and performing a white point balancing process on the 
original image. The method also includes segmenting the 
white point balanced image into a plurality of sub-images, 
sampling each sub-image to obtain color channel data for 
each sub-image, selecting sub-images with a highest 
standard deviation of color channel data, andanalyzing 
the selected sub-images to calculate a composite color 
channel mean for each color channel of the white point 
balanced image. For correcting the color of the image, the 
method also includes selecting a first color channel with a 
highest composite color channel mean, a second color 
channel with an intermediate composite color channel 
mean, and a third color channel with a lowest composite 
color channel mean, applying a power function on the first 
and third color channels of the white point balanced im- 



age to approximately equalize the color channel means of 
the first, second, and third color channels, andoutputting 
a restored image. 

[0007] it j S an advantage of the claimed invention that the means 
of all color channels are approximately equalized for bal- 
ancing colors of the image, providing good color quality, 
and preserving good density of the image. 

[0008] These and other objectives of the claimed invention will 

no doubt become obvious to those of ordinary skill in the 

art after reading the following detailed description of the 

preferred embodiment, which is illustrated in the various 

figures and drawings. 
Brief Description of Drawings 

[0009] pig.l is a flowchart summarizing the present invention 

method of restoring color of an image. 
[0010] pig. 2 shows an original image to be restored. 

[001 1] pig. 3 is a histogram of color channel data for the present 
invention. 

[0012] Fig. 4 illustrates an algorithm for calculating the lower 
bound and upper bound for each color channel. 

[0013] Fig. 5 illustrates the effects of a white point balancing pro- 
cess. 



[0014] pig. 6 is a diagram of an image being segmented into sub- 
images according to the present invention. 
[0015] pig. 7 is a flowchart illustrating the color correction 

method of the present invention. 
Detailed Description 

[0016] please refer to Fig.l and Fig. 2. Fig.l is a flowchart sum- 
marizing the present invention method of restoring color 
of an image. Fig. 2 shows an original image J or ' 9 to be re- 
stored. In step 100 of the flowchart shown in Fig.l, the 
original image J orig is read. The original image l orig may 
be a photograph or film. First, an outside border of the 
original image l or ' 9 is ignored in step 102 since the bor- 
der may not contain any image data. Therefore, only an 
interior image / is used in the color restoration process of 
the present invention. Next, a white point balancing pro- 
cess is performed in step 104. The interior image / is then 
split into a plurality of sub-images in step 106. Sub- 
images with greatest color variance are selected in step 
108, and are referred to as a region of interest. A mean 
for each color channel (such as red, green, and blue) is 
then calculated, and the means for respective color chan- 
nels are compared with each other. The three color chan- 
nels are sorted according to the value of their means. A 



proper power function is then determined in step 110 for 
correcting the color channels with the highest and lowest 
means. In step 112, the power function is then applied to 
the entire image, thereby causing all three color channels 
to have an approximately equal mean and restoring the 
color quality of the original image l or ' 9 . 
[0017] a detailed description of the present invention method 
will now be described. First of all, the size of the original 
image l ong is calculated, and / or ' 9 has 



rows and 



columns. Next, as shown in Fig. 2, a frame size FS is cal- 
culated around a border of the original image 7 orig , such 
that 



, where IFR is the Image-Frame Ratio. The interior section 
of the original image J orig is referred to as an interior im- 
age I, which is formed by removing FS pixels from each 
side of the image l or ' 9 . The interior image ihas I rows and 

m 

I columns. Then a histogram of each channel of lis calcu- 
lated. The histogram H for the R channel, for example, is 

R 

computed such that 



,where 



h t =#({j? \P = i'P^ thepbid valuein R. channel}) 



, and #(-)is the counting measure from set to 



SR (or I) 



. If I I is too large, sample pixels can be taken from the 

m n 

interior image iinstead. A histogram will be calculated for 
each channel R, G, and B. Since the histogram H is com- 
puted in the same way for each channel, it will only be ex- 
plained once. 

[0018] please refer to Fig. 3. Fig. 3 is a histogram of color channel 
data for the present invention. The histogram in Fig. 3 
shows the number of pixels in the image I having a certain 
color value. As an example, the histogram shown in Fig. 3 
assumes 8-bit color is used, and the color values can 
range from 0 to 255. Next, a lower bound IL and an upper 
bound IU are calculated for the interior image I. The lower 



and upper bounds IL and IU are calculated according to a 
predetermined fraction cof pixels in the image I (for ex- 
ample, the fraction c may have a value of 0.05). For each 
channel, 

JZ-SUp<H 

i-<> 



and 



IU=mf(n\±h ! >(l-c)IJJ 

1-0 



, where c is a fixed number between 0 and 1, and h is the 

i 

number of pixels for a given color value. 
[0019] please refer to Fig. 4. Fig. 4 illustrates an algorithm for cal- 
culating the lower bound IL and upper bound IU for each 
color channel. The algorithm begins in step 140, and vari- 
ables are initialized in step 142. The variable HSum is 
used to calculate a total sum of pixels in the histogram, 
and i is a counter variable for indicating the color value. In 
steps 144 and 146, the i counter is incremented and the 
value of h(i) is added to HSum. According to step 148, 
steps 144 and 146 are repeated until HSum is greater 
than or equal to c*l *l . Once HSum is greater than or 

m n 



equal to c*l *l , the value of the lower bound IL is set 

m n 

equal to the current value of i in step 150. To calculate 
the upper bound IU, the i counter is incremented and the 
value of h(i) is added to HSum in steps 152 and 154. Ac- 
cording to step 156, steps 152 and 154 are repeated until 
HSum is greater than or equal to (l-c)*l *l . Once HSum 

m n 

is greater than or equal to (l-c)*l *l , the value of the up- 

m n 

per bound IU is set equal to the current value of i-1 in 
step 158. Once the lower bound IL and the upper bound 
IU are calculated, the algorithm is ended in step 160. 
[0020] After the lower bound IL and the upper bound IU have 
been calculated, a white point balancing process is per- 
formed. In this process, the color value of each pixel pix 
of the considered channel will be replaced by: 



tOU if pix>IU 
OL + (OU-OL)(p!x-IL)/(IU-IL) if JL<pix<IU 
OL if pix<IL 



[0021] The effects of the white point balancing process are illus- 
trated in Fig. 5. The output lower bound OL and output 
upper bound OU are defined in terms of the input lower 
bound IL and the input upper bound IU. After the white 
point balancing process has been performed, the image I 
is segmented into mn sub-images. Each of the sub- 
images is referred to as sub-image l„, where 0<i<mand 
0<j<n. Please refer to Fig. 6. Fig. 6 is a diagram of image I 
being segmented into sub-images ^according to the 
present invention. The center of each sub-image l„has a 
centerindicated by point 20 on Fig. 6, which has the coor- 
dinates (idx ,idx ). A top-left corner of each sub-image I 

m n 



is located at the point 

(idx -radius Jdx -radius ) 

m m ■ n n ' 



and a lower-right corner is located at the point 



(idx + radius ,idx + radius ) 

m m ■ n i' 



, where 



and idx =[(j-l)l /n]. 

n n 

[0022] please refer to Fig. 7. Fig. 7 is a flowchart illustrating the 
color correction method of the present invention. After 
generating the sub-images 




, a histogram 




is calculated for each generated for each sub-image 



Utilizing the histograms 



, a mean M and standard deviation S are calculated. Alter- 

U U 

natively, the means M and standard deviations S also be 

U U 

calculated directly from I . Once the standard deviations S 
are calculated, the standard deviations S are rearranged 

U U 

as a decreasing sequence S , thereby forming set 

k 



. Then, a cutoff point p is defined as p=[cl-#(T)] with 
0<.cl,l The elements in the decreasing sequence S 
greater than the cutoff point pare then selected to be in a 

k 

set 



That is, the set ROI contains the higher standard devia- 
tions S„, and is referred to as the region of interest in step 
170 of the flowchart in Fig. 7. Using the set ROI, the mean 
of 



{I 9 \T 9 mROI) 



is computed for each channel, which will respectively be 
referred to as R ,G ,B for the red, green, and blue chan- 

m m m 

nels (step 172). Next, the means R ,C ,B will be sorted 

m m m 

in increasing order in step 174, and labeled as values 
(s,m,l), without loss of generality, we assume s=R ,m=G 

m 

,I = B . In step 176, exponents g ,g ,and g correspond- 

m m s m 1 

ing to the labels s, m, and / are all initialized to a value of 
1. For the R channel, the mean R is less than the mean G 

m 

. To equalize the means R and G , a power function 
«x)=x^isapp.iedtoth e c m orrespo m ndin g RO.se t oftheR 
channel in step 178, where g s >l- The value of gjs re- 
peatedly incremented by a small fixed amount k (such as 



0.1 or less) in step 182 until the relationship abs(mdan(f(l 
in ROI)-m)<tolerance is satisfied in step 180. Once this 

U 

relationship is satisfied, the means R and G are approxi- 

m m 

mately equalized. In steps, 184, 186, and 188, the same 
process is repeated for equalizing means B and G . The 

m m 

only difference is the value of g^s repeatedly decre- 
mented by the small fixed amount k so that g i <l. After 
these values of g and g have been calculated using the 

^ l/G 

set ROI, the power function f(x)=x is applied to the R, G, 
and B color channels of the entire image I for equalizing 
the R, G, and B color channels. 

[0023] | n contrast to the prior art, the present invention method 
equalizes color channel levels to provide good color qual- 
ity and preserve good density of the image. If a photo- 
graph is being restored, the corrected image will no 
longer have a yellowish tint. If film is being restored, the 
corrected image will no longer have a reddish tint. There- 
fore, the present invention method provides a way to re- 
store aged photographs and film through a simple mathe- 
matical algorithm. 

[0024] Those skilled in the art will readily observe that numerous 
modifications and alterations of the device may be made 
while retaining the teachings of the invention. Accord- 



ingly, the above disclosure should be construed as limited 
only by the metes and bounds of the appended claims. 



